4D-OR: Semantic Scene Graphs for OR Domain Modeling

نویسندگان

چکیده

Surgical procedures are conducted in highly complex operating rooms (OR), comprising different actors, devices, and interactions. To date, only medically trained human experts capable of understanding all the links interactions such a demanding environment. This paper aims to bring community one step closer automated, holistic semantic modeling OR domain. Towards this goal, for first time, we propose using scene graphs (SSG) describe summarize surgical scene. The nodes represent actors objects room, as medical staff, patients, equipment, whereas edges relationships between them. validate possibilities proposed representation, create publicly available 4D SSG dataset, 4D-OR, containing ten simulated total knee replacement surgeries recorded with six RGB-D sensors realistic simulation center. 4D-OR includes 6734 frames is richly annotated SSGs, object poses, clinical roles. We an end-to-end neural network-based generation pipeline, rate success 0.75 macro F1, indeed being able infer reasoning OR. further demonstrate representation power our by it problem role prediction, where achieve 0.85 F1. code dataset at github.com/egeozsoy/4D-OR .

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Crime Scene or Event Scene?

This article has not an abstract

متن کامل

On Support Relations and Semantic Scene Graphs

Rapid development of robots and autonomous vehicles requires semantic information about the surrounding scene to decide upon the correct action or to be able to complete particular tasks. Scene understanding provides the necessary semantic interpretation by semantic scene graphs. For this task, so-called support relationships which describe the contextual relations between parts of the scene su...

متن کامل

Discussion on ‘4D-Var or EnKF?’

The development of data assimilation techniques for numerical weather prediction has been very successful ever since the early 1950s until now, starting with simple two-dimensional and univariate spatial interpolation techniques like the successive corrections (SC, Bergthorsson and Döös, 1955) ending up with the four-dimensional variational data assimilation (4D-Var, Rabier et al., 2000) and en...

متن کامل

Lessons from scene graphs: using scene graphs to teach hierarchical modeling

The scene graph, as defined in VRML and Java3D, is a powerful tool for modeling a scene. The ideas contained in the scene graph are fundamental principles in modeling. They give beginning computer graphics students the tools to understand and apply the techniques of hierarchical modeling in scene design and can be directly applied to graphics programming in several graphics APIs, including Open...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Lecture Notes in Computer Science

سال: 2022

ISSN: ['1611-3349', '0302-9743']

DOI: https://doi.org/10.1007/978-3-031-16449-1_45